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TITLE OF THE INVENTION 

IMAGE PROCESSING APPARATUS AND METHOD 

5 BACKGROUND OF THE INVENTION 

Field of the Invention 

This invention relates to an image processing 
apparatus and method for processing image data to be 
10 transmitted by electronic mail, facsimile, and the like, 
and a program for implementing the method. 

Description of the Related Art 

In recent years, methods have been proposed in 

15 which a facsimile apparatus transmits image data 

obtained by reading an original by a scanner, as an 
attached file by electronic mail to the Internet. For 
example, image data obtained by reading an image on an 
original by a scanner of a facsimile apparatus is 

2 0 transmitted in a TIFF (Tag Image File Format) by 
electronic mail. 

There will now be described a method of 
transmitting an electronic mail by a conventional 
facsimile apparatus. 

25 First, a user sets originals to be transmitted in 

a reader of the facsimile apparatus, and selects a 
destination and instructs the facsimile apparatus to 



start the transmission. 

The facsimile apparatus reads the originals set in 
the reading section on a sheet-by-sheet basis to code 
the read images in the MMR (Modified Modified READ) 
5 method (or in the MH or MR method) , and then converts 
the coded data into TIFF files. In this TIFF 
conversion, TIFFClassF header information is added to 
the top of image data in a G3 format to generate TIFF 
image data. The TIFF image data, which is binary data, 

10 is converted into text data. An electronic mail header 
is then added to the TIFF image data that is to be 
converted into the text data . Upon completion of data 
in an electronic mail format in this manner, the 
electronic mail is transmitted by SMTP (Simple Mail 

15 Transfer Protocol) . 

For facsimile transmission, originals are read in 
the same manner as in the electronic mail transmission, 
and MMR-coded image data is transmitted according to a 
known facsimile communication procedure such as G3 . 

20 Such a facsimile apparatus is required to transmit 

image data obtained by reading an original in the 
photographic size by electronic mail, but an image in 
the photographic size which is much smaller than the A4 
size is conventionally transmitted as image data in the 

25 A4 size by adding white pixels. This is because the 
same process is carried out until the generation of 
MMR-coded image data in both the electronic mail 
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transmission and the facsimile transmission. 

Therefore, the conventional facsimile apparatus 
has to transmit image data in an excessive data size 
when a small image in the photographic size or the like 
5 is supplied to a destination, and makes it difficult to 
see the area of an original since an unnecessary area 
is displayed when the transmitted image data is 
displayed on a display of a personal computer (PC), etc. 

10 SUMMARY OF THE INVENTION 

It is therefore an object of the present invention 
to provide an image processing apparatus and method 
that solves- the above described programs and a program 

15 for implementing the method. 

It is another object of the present invention to 
provide an image processing apparatus and method that 
enables the output of image data in a size suitable for 
a transmission method that is employed, and a program 

20 for implementing the method. 

It is yet another object of the present invention 
to provide an image processing apparatus and method 
that processes image data into a predetermined size if 
it is transmitted via facsimile and outputs image data 

25 without processing it if it is transmitted via 

electronic mail, and a program for implementing the 
method. 



To attain the above objects, a first aspect of the 
present invention provides an image processing 
apparatus comprising an input ter arranged to input 
image data representing an image, a processor arranged 
5 to process the image data input by the inputter in a 
manner such that the image represented by the image 
data has a predetermined size, a first producer 
arranged to produce data for transmission by facsimile 
based on the image data input by the inputter, a second 

10 producer arranged to produce data for transmission by 
electronic mail based on the image data input by the 
inputter, and a controller arranged to control the 
first and second producers in a manner such that when 
the data for transmission by facsimile is produced by 

15 the first producer, the data for transmission by 

facsimile is produced after the image data input by the 
inputter is processed by the processor, and when the 
data for transmission by electronic mail is produced by 
the second producer, the data for transmission by 

2 0 electronic mail is produced without the image data 

input by the inputter being processed by the processor. 

Preferably, the inputter inputs the image data 
from a reader which reads the image and generates the 
image data based on the image. 

2 5 Also preferably, the inputter inputs the image 

data from a detachable memory. 

Preferably, the processor processes the image data 



input by the inputter by adding white pixels thereto so 
as for the image represented by the image data to have 
the predetermined size. 

Preferably, the controller controls the first 
5 producer and the second producer such that the first 
producer and the second producer use different rvalues 
in producing the data. 

Also preferably, the controller restricts 
operations of the first and second producers according 

10 to a predetermined condition. 

To attain the above object, the first aspect of 
the present invention also provides an image processing 
method comprising an inputting step of inputting image 
data representing an image, a processing step of 

15 processing the image data input in the inputting step 
in a manner such that the image represented by the 
image data has a predetermined size, a first producing 
step of producing data for transmission by facsimile 
based on the image data input in the inputting step, a 

2 0 second producing step of producing data for 

transmission by electronic mail based on the image data 
input in the inputting step, and a controlling step of 
controlling the first and second producing steps in a 
manner such that when the data for transmission by 

25 facsimile is produced in the first producing step, the 
data for transmission by facsimile is produced after 
the image data input in the inputting step is processed 
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in the processing step, and when the data for 
transmission by electronic mail is produced in the 
second producing step, the data for transmission by 
electronic mail is produced without the image data 
5 input in the inputting step being processed in the 
processing step. 

To attain the above object, the first aspect of 
the present invention further provides a computer 
readable program stored in a storage medium, comprising 

10 an inputting module for inputting image data 

representing an image, a processing module for 
processing the image data input by the inputting 
module in a manner such that the image represented by 
the image data has a predetermined size, a first 

15 producing module for producing data for transmission by 
facsimile based on the image data input by the 
inputting module, a second producing module for 
producing data for transmission by electronic mail 
based on the image data input by the inputting module, 

20 and a controlling module for controlling the first and 
second producing modules in a manner such that when the 
data for transmission by facsimile is produced by the 
first producing module, the data for transmission by 
facsimile is produced after the image data input by the 

25 inputting module is processed by the processing module, 
and when the data for transmission by electronic mail 
is produced by the second producing module, the data 



for transmission by electronic mail is produced without 
the image data input by the inputting module being 
processed by the processing module. 

To attain the above objects, a second aspect of 
the present invention provides an image processing 
apparatus comprising an inputter arranged to input 
image data representing an image, a first producer 
arranged to produce data for transmission by facsimile 
based on the image data input by the inputter, a second 
producer arranged to produce data for transmission by 
electronic mail based on the image data input by the 
inputter, and a controller arranged to control a 
process to be performed on the image data input by the 
inputter before the image data is supplied to the first 
producer or the second producer, according to a size of 
the image represented by the image data input by the 
inputter . 

Preferably, the inputter inputs the image data 
from a reader which reads the image and generates the 
image data based on the image . 

Preferably, the inputter inputs the image data 
from a detachable memory. 

Also preferably, when the size of the image 
represented by the image data input by the inputter is 
smaller than a predetermined size and the image data 
input by the inputter is to be transmitted by facsimile, 
the controller supplies the image data input by the 
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inputter to the first producer after processing the 
image data input by the inputter such that the size of 
the image represented by the image data input by the 
inputter becomes equal to the predetermined size. 
5 Preferably, when the image data input by the 

inputter is to be transmitted by electronic mail, the 
controller causes the second producer to produce a file 
corresponding to the size of the image represented by 
the image data input by the inputter. 

10 More preferably, when it is set that the image 

data input by the inputter is to be transmitted by 
electronic mail as the file having a predetermined size, 
the controller causes the second producer to produce 
the file having the predetermined size irrespective of 

15 the size of the image represented by the image data 
input by the inputter . 

Preferably, when the image represented by the 
image data input by the inputter is a color image, the 
controller inhibits supply of the image data input by 

20 the inputter to the first and second producers. 

More preferably, the image represented by the 
image data input by the inputter is a color image 
having a size smaller than a predetermined size, the 
controller permits supply of the image data input by 

25 the inputter to the first and second producers. 

To attain the above objects, the second aspect of 
the present invention also provides an image processing 
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method comprising an inputting step of inputting image 
data representing an image, a first producing step of 
producing data for transmission by facsimile based on 
the image data input in the inputting step, a second 
5 producing step of producing data for transmission by- 
electronic mail based on the image data input in the 
inputting step, and a controlling step of controlling a 
process to be performed on the image data input in the 
inputting step before the image data is supplied to the 

10 first producing step or the second producing step, 
according to a size of the image represented by the 
image data input in the inputting step. 

To attain the above objects, the second aspect of 
the present invention further provides a computer 

15 readable program stored in a storage medium, comprising 
an inputting module for inputting image data 
representing an image, a first producing module for 
producing data for transmission by facsimile based on 
the image data input by the inputting module, a second 

20 producing module for producing data for transmission by 
electronic mail based on the image data input by the 
inputting module, and a controlling module for 
controlling a process to be performed on the image data 
input in the inputting module before the image data is 

25 supplied to the first producing module or the second 
producing module, according to a size of the image 
represented by the image data input by the inputting 
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module . 

The above and other objects, features and 
advantages of the present invention will be more 
apparent from the following detailed description taken 
5 in conjunction with the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram showing the arrangement 
10 of a communication system incorporating an image 

processing apparatus according to each of first and 
second embodiments of the present invention; 

FIGS. 2A and 2B is a block diagram showing the 
arrangement of a facsimile apparatus as the image 
15 processing apparatus according to the first or second 

embodiment of the present invention and a hand scanner; 

FIG. 3 is a flow chart showing a process carried 
out in reading with the hand scanner according to the 
first embodiment of the present invention; 
2 0 FIGS. 4A and 4B is a flow chart showing a process 

carried out in a state wherein the hand scanner is 
mounted according to the first embodiment of the 
present invention ; 

FIG. 5 is a flow chart showing a continued part of 
2 5 the FIGS. 4A and 4B process; 

FIG. 6 is a flow chart showing a process for 
reading sheets according to the first embodiment of the 
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present invention ; 

FIG. 7 is a flow chart showing a process for 
obtaining image data from an external recording medium 
(CF card) according to the first embodiment of the 
5 present invention; 

FIG. 8 is a flow chart showing a continued part of 
the FIG. 7 process; 

FIG. 9 is a block diagram showing the arrangement 
of a communication system incorporating an image 
10 processing apparatus according to a variation of the 

first and second embodiments of the present invention; 

FIG. 10 is a view useful in explaining an example 
of the structure of data stored in a storage medium 
storing a program and related data for executing an 
15 image processing method according to the present 
invention; and 

FIG. 11 is a view useful in conceptually 
explaining an example in which a program and related 
data for executing the image processing method 
2 0 according to the present invention are supplied from a 
storage medium to an apparatus such as a computer. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

25 The present invention will now be described in 

detail with reference to the drawings showing 
embodiments thereof . 
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[First embodiment] 

FIG. 1 is a schematic block diagram showing the 
arrangement of a communication system incorporating an 
image processing apparatus according to a first 
5 embodiment of the present invention. This communication 
system is comprised of a facsimile apparatus 101, a 
hand scanner 102, a digital camera 103, a communication 
network such as ISDN (Integrated Services Digital 
Network) , a facsimile apparatus (FAX) 105 at a 

10 destination, an internet service provider (ISP) 106, 
and a computer (PC) 107 at a destination. 

The arrangement of the communication system will 
now be described in detail. The facsimile apparatus 
101, the destination facsimile apparatus 105 and the 

15 destination computer 107 communicate with one another 
through the communication network 104. The facsimile 
apparatus 101 is capable of mounting thereon the 
detachable hand scanner 102, and is intended to read 
various kinds of images. The digital camera 103 is 

2 0 capable of mounting thereon a detachable storage medium 
storing image data captured by the digital camera 103 . 
It is assumed that image data is exchanged between the 
hand scanner 102 and the digital camera 103 via a 
storage medium such as a compact flash (CF) card and a 

25 smart medium. The internet service provider (ISP) 106 
provides a service for connection to the Internet. 

FIGS. 2A and 2B is a block diagram showing the 
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arrangement of the facsimile apparatus 102 as the image 
processing apparatus according to the first embodiment 
and the hand scanner 102 in the communication system of 
FIG. 1. The facsimile apparatus 101 according to the 
5 first embodiment is comprised of a CPU 201, a ROM 203, 
a SRAM 204, a CPU 205, a ROM 207, a RAM 208, a shared 
register 209, a shared register 210, a printer image 
processing section 211, a color printer 212, an 
operation panel 213, a fax modem 214, a handset 215, a 

10 speaker 216, a cross point switch 217, a DSU 219, an 
ISDNI interface 220, a HDLC controller 221, a PIAFS 
controller 222, a PHS processing section 223 having a 
CPU 224 and a TDMA processing section 225, a 1 . 9GHz 
high frequency section 226, a PCM CODEC 227, a PCM 

15 CODEC 228, a PCM/ADPCM converting section 229, a 
PCM/ADPCM converting section 230, a path selector 
switch 231, and a path selector switch 232. The hand 
scanner 102 is comprised of a CPU 241, a RAM 241, a CIS 
243, an A/D converting section 244, a shading 

20 correcting section 245, a color conversion selecting 
section 246, a RGB/LAB color space converting section 
247, a RGBY/CbCr color space converting section 248, a 
7 converting section A 249, a JPEG compressing 
expanding section 2 50, a 7 converting section B 2 51, a 

25 resolution converting section 252, a CF card interface 
253, and a binary-coding section 255. 

The arrangement of the facsimile apparatus will 
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now be described in detail. In the facsimile apparatus 
101, the CPU 201 reads a program stored in the ROM 203 
through a system bus 202 including data and address 
buses, and carries out various controlling operations 
5 including later described controlling operations 

according to the program using the SRM 2 04 as a work 
memory. The CPU 2 05 reads a program stored in the ROM 
207 through a system bus 206 including data and address 
buses, and carries out various controlling operations 

10 such as JPEG compression and expansion of digital image 
data by middleware using the RAM 208 as a work memory. 

A system of components on the side of the CPU 201 
interconnected by the system bus 202 and a system of 
components on the side of the CPU 205 interconnected by 

15 the system bus 2 06 exchange data through the shared 
register 209 connected between them. Likewise, the 
system on the side of the CPU 205 and the hand scanner 
102 exchange data through the shared register 210 
connected between them. 

2 0 The operation panel 213 connected to the system 

bus 206 is equipped with a display such as a LCD, 
numeric keys, various kinds of keys, and an electronic 
mail button. The operation panel 213 is used for a 
user to operate the facsimile apparatus 101 and is used 

25 to display the operating conditions of the facsimile 
apparatus 101. 

The fax modem 214 is controlled by the CPU 205 
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through the system bus 2 06, and is connected to the 
cross point switch 217. The handset 215 and the 
speaker 216 are also connected to the cross point 
switch 217. With this arrangement, sounds inputted 
5 from a communication line and analog data from the 

facsimile apparatus can be supplied to the handset 215, 
the speaker 216 and the fax modem 214 via the cross 
point switch 217, and sounds and analog data outputted 
from the handset 215 and the fax modem 214 can be 

10 outputted to the communication line. 

The DSU (Digital Service Unit) 219 connected to an 
ISDN line (U point) 218 converts data, which is 
exchanged between the ISDN line 218 and an exchange, 
into TTL level signals. 

15 The ISDN interface 22 0 controls layers 1 to 3 of 

the ISDN, and has a function of inputting and 
outputting data in a channel B of the ISDN. The HDLC 
controller 221 assembles and disassembles data of a 
HDLC (Highlevel Data Link Control procedure) format in 

2 0 the ISDN. The PIAFS (PHS Internet Access Forum 

Standard) controller 222 is a radio data communication 
protocol format processing section that assembles and 
disassembles frames in a radio data communication 
protocol format . 

25 In the PHS processing section 223, the CPU 224 

carries out a process for protocol process for PHS 
(Personal Handy-phone System) radio communication, and 
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the TDMA (Time Division Multiple Access) processing 
section 225 assembles and disassembles frames 
transmitted and received by time-division multiplexing 
in four slots. The 1 . 9GHz high frequency section 226 
5 connected to the PHS processing section 223 transmits 
and receives radio waves of a 1 . 9GHz band. It should 
be noted that the use of the PHC processing section 223 
enables a digital cordless telephone to be accommodated 
as an extension. 

10 The PCM CODECS 227, 228 convert analog signals and 

PCM (Pulse Code Modulation) code data. The PCM/ADPCM 
converting sections 229, 230 convert ADPCM (Adaptive 
Differential Pulse Code Modulation) code data 
transmitted through a radio line of the PHS. 

15 The path selector switches 231, 232 are switched 

for selecting an analog signal such as a facsimile 
signal or a sound signal transmitted from a digital 
cordless telephone via the PHS processing section 223 
as data to be transmitted through the ISDN line 218 

2 0 under the control of the CPU 2 01. 

There will now be described principal signal lines. 
Reference numeral 23 3 denotes a serial communication 
line for exchanging control signals between the CPU 201 
and the CPU 205. Reference numerals 234 to 236 denote 

25 serial signal lines which are inputted to and outputted 
from the ISDN interface 220. The ISDN interface 220 
selects two lines among those signal lines, and 
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connects them to channels Bl and B2 of the ISDN line 
218. Reference numerals 237 and 238 denote signal 
lines which are inputted to and outputted from the fax 
modem 214 and the handset 215. Reference numeral 239 
5 and 240 denote signal lines for ADPCM-coded sound data 
which are inputted to and outputted from the digital 
cordless telephone. 

The arrangement of the hand scanner will now be 
described in detail. In the hand scanner 102, the CPU 

10 241 formed of a one-chip microprocessor or the like 

reads a program stored in an internal ROM or the like 
and carries out various controlling operations 
including later-described controlling operations 
through a system bus 254 including data and address 

15 buses according to the program using the RAM 2 42 as a 
work memory. 

The CIS (Contact Image Sensor) 243 for reading an 
image on an original includes a LED array for emitting 
red (R) , green (G) and blue (B) lights and a line CCD. 

2 0 Upon receipt of a read timing signal, the CIS 243 

outputs a video signal representing a read image in 
synchronism with the read timing signal. The A/D 
converting section 2 44 converts the video signal 
outputted from the CIS 243, from analog form to digital 

25 form. The shading correcting section 245 performs 

shading-correction of RGB image data outputted from the 
A/D converting section 244. 



18 

Under the control of the CPU 241, the color 
conversion selecting section 246 selects a place from 
which the RGB image data is inputted and a place to 
which the RGB image data is output ted. The place from 
5 which the RGB image data is inputted is selected from 
the shading correcting section 245 and the RAM 242, and 
the place to which the RGB image data is outputted is 
selected from the y converting section A249, the y 
converting section B 251, and the RAM 242. 

10 For color facsimile communication, the inputted 

RGB image data is outputted to the 7 converting section 
A249, and the resulting data is outputted to the 
RGB/LAB color space converting section 247. 

Consequently, the RGB image data is converted into 

15 image data of a CIELab color space. On the other hand, 
when a color image is transmitted as an attachment to 
an electronic mail, the inputted RGB image data is 
outputted to the y converting section B 251, and the 
converted data is outputted to the RGB/YCbCr color 

20 space converting section 247. Hence, the RGB image 
data is converted into image data of a YCbCr color 
space . 

It should be noted that the y conversion performed 
by the y converting section A249 is similar to the y 
2 5 conversion performed by y converting section B 251 

except for a value of 7, because different parameters 
are used in the y conversion between a color facsimile 
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intended for printing and an electronic mail intended 
for display. Usually, the value of 7 is equal to 1.0 in 
the case of a color facsimile whereas the value of y 
is equal to about 1.8 or 2.2 in the case of a display. 
5 The JPEG compressing and expanding section 250 

performs DCT (Discrete Cosine Transform) of the 
inputted image data of the Lab or YcbCr color space, 
and then quantizes /Huffman-codes the image data to 
output JPEG {Joint Photographic Expert Group) image 

10 data. Also, the JPEG compressing expanding section 250 
expands the inputted JPEG data to output RGB 
uncompressed image data. The same algorithms are used 
in the DCT operation and the quantization/Huffman- 
coding as in the conventional JPEG compression. 

15 The binary-coding section 255 converts image data 

of RGB color space into CMYK binary data for printing, 
or converts image data of a gray scale into 
monochromatic binary data for printing. The CF card 
interface 253 provides interface for use in reading 

2 0 JPEG image data that is captured by a digital camera, 
etc. to be recorded in a CF (Compact Flash) card, etc. 
The resolution converting section 252 converts the 
resolution of RGB image data. 

The RGB/YCbCr converting section 248 converts the 

25 r (=1 . 0) -converted RGB data of 256 gradations into 

YCbCr data of 256 gradations. The RGB/YCbCr converting 
section 248 obtains the values of Y, Cb, Cr for each 
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pixel by carrying out the following operations for the 
values of R, G, B for each pixel: 

Y=0 . 29900R+0 . 587 0 0G+0 . 11400B-0x80 

Cb=-0 . 16874R-0 .33126G-0. 500000B 
5 Cr=0.50000R-0.41869G-0.0813lB 

The RGB/Lab converting section 247 converts the 7 
(=1.8 or 2 . 2 ) -converted RGB data of 256 gradations into 
Lab data of 256 gradations. The RGB/Lab converting 
section 247 obtains the values of L, a, b for each 
10 pixel by carrying out the following operations for the 
values of R, G, B for each pixel: 



x= (8164*R+6004*G+22 81*B) / (2 "22) ; 



y=(3 666*R+12 872*G-90*B) / (2~22) ; 



z= (302*R-887*G+17027*B) / (2~22) ; 



15 



if (x>l . 0 ) x=l . 0 ; if (x<0 . 0 ) z=0 . 0 ; 



if (y>l. 0)y=l. 0; if (y<0 . 0)y=0 . 0 ; 



if (z>l. 0) z=l. 0; if (z<0 . 0) z=0 . 0; 



if (x<0. 008856) [x=7 . 787*x+16/116 ; ] else x=x~(l/3) 



if (y<0. 008856) [y=7 . 787*y+16/116 ; ] else y=y"(l/3) 



20 



if (z<0. 008856) [z=7 . 787*z+16/116 ; ] else z = z"(l/3) 



ll=116*y-16; 



al=500* (x-y) ; 



bl=200* (y-z) ; 



L=ll*2.56; if(L<0)L=0; if (L>255 ) L=255 ; 



25 



a=(al*255/170)+128; if(a<0)a=0; if ( ia>255 ) a=2 55 ; 



b= (bl*255/200)+96; if(b<0)b=0; if (b>255 ) b=255 ; 



The hand scanner 102 reads an image with a reading 
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width that can be selected by the user from a 
photographic width (127mm), an A4 width (214mm), and a 
B4 width (257mm) . 

There will now be described the initialization of 
5 the facsimile apparatus. The present facsimile 

apparatus has a function of presetting a destination 
address and electronic mail related information to 
enable the easy transmission by facsimile and 
electronic mail. Destinations of facsimiles or phone 

10 calls may be registered in a telephone directory. The 
procedure for registration will be described below. 
Note that the CPU 2 01 of the facsimile apparatus 101 
provides control relating to the initialization. 

The user inputs the name of a destination by means 

15 of numerals, alphabets, hiragana letters, katakana 

letters, Chinese characters, and marks through numeric 
keys of the operation panel 213, and then inputs a 
telephone number. If there is any additional 
information, the user subsequently inputs the 

2 0 corresponding items. Each piece of information is used 
as one telephone number data. Registered telephone 
number data is selected by designating a registered 
name so that it can be used for communication. 
Incidentally, users in Japan usually input such 

2 5 information by means of hiragana letters and Chinese 
characters, and thus, hiragana letters and Chinese 
characters are set as defaults if the present facsimile 
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apparatus is intended to be installed in Japan. In 
this case, the defaults can be switched to alphabets by 
operating predetermined keys . 

As for the transmission of an electronic mail, the 
5 following items are set. It should be noted that the 
following items are set interactively on a user 
interface screen displayed in a display section of the 
operation panel 213 in the facsimile apparatus 101. 
The transmission of an electronic mail requires 

10 information for connection with an ISP (Internet 

Service Provider) and information for designating a 
destination address. 

The connection with the ISP requires an access 
telephone number of the ISP; a login name and password 

15 supplied by the ISP; and a primary name server address, 
a secondary name server address and an SMTP server name 
of the ISP. Such information is inputted by means of 
numerals, alphabets, hiragana letters, katakana letters, 
Chinese characters, and marks through numeral keys of 

20 the operation panel 213. If there is any additional 
information, the corresponding items are subsequently 
inputted. Since such additional information can be 
inputted by using only alphanumeric characters, the 
depression of an OK key in response to a question 

25 asking whether server information is to be inputted or 
not on the user interface screen of the operation panel 
213 automatically switches an input mode to a mode for 
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inputting frequently-used alphanumeric characters 
(alphanumeric character input mode) . 

A user name is given to a group of such data in 
order to keep a plurality of sets of information for 
5 connection with the ISP. A user name is inputted by 
means of numerals, alphabets, hiragana letters, 
katakana letters, Chinese characters, and marks through 
numeric keys of the operation panel 213. Note that 
hiragana letters and katakana letters are selected as 

10 defaults for the input mode as in the case where a 

destination of a phone call is inputted as described 
above. Each piece of information is used as one 
connection data. Registered connection data is 
selected by designating a user name so that it can be 

15 used for communication. 

The designation of a destination address requires 
an electronic mail address of the destination. Such a 
destination address is registered by inputting the name 
of the destination and an electronic mail address of 

20 the destination by means of numerals, alphabets, 

hiragana letters, katakana letters, Chinese characters, 
and marks through numeric keys of the operation panel 
213. When the name of a destination is inputted, the 
depression of the OK key in response to a question 

25 asking whether the name of a destination is to be 

inputted or not on the user interface screen of the 
operation panel 213 automatically switches the input 
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mode to a mode for inputting hiragana letters and 
Chinese characters. When an electronic mail address is 
inputted, the depression of the OK key in response to a 
question asking whether an electronic mail address is 
5 to be inputted or not on the user interface screen of 
the operation panel 213 automatically switches the 
input mode to a mode for inputting alphanumeric 
characters which are frequently used to represent an 
electronic mail address (alphanumeric character input 
10 mode) . 

If there is any additional information, the 
corresponding items are subsequently inputted. Each 
piece of such information is used as one destination 
address data. Registered destination address data is 

15 selected by designating a registered name so that it 

can be used for communication. The destination address 
data is registered together with the telephone number 
data in the telephone directory, and is also registered 
in an electronic mail directory containing only 

2 0 destination address data independently from the 
telephone directory. 

The present facsimile apparatus may also transmit 
an electronic mail with a subject that is optionally 
added, although this is inessential. A subject of an 

2 5 electronic mail is inputted by means of numerals, 

alphabets, hiragana letters, katakana letters, Chinese 
characters, and marks through numeric keys of the 
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operation panel 213. When a subject of an electronic 
mail is inputted, the depression of the OK key in 
response to a question asking whether a subject of an 
electronic mail is to be inputted or not on the user 
5 interface screen of the operation panel 213 

automatically switches the input mode to a mode for 
inputting frequently-used kana letters and Chinese 
characters which are frequently used in Japan (kana 
letter input mode) . 

10 The arrangement of the telephone directory that 

can contain electronic mail data will now be described. 
A telephone number list and a destination address list 
are stored on the RAM 208. A pointer is put on the 
telephone number list or the destination address list 

15 according to a value of an electronic mail flag from 
structures having electronic mail flags and name 
information. A group of structures is stored on the 
RAM 2 08 as an array that is sorted according to the 
name information. When electronic mail addresses are 

2 0 registered in the telephone directory, they are stored 
together with electronic mail flags and displayed with 
marks on the telephone directory. 

It should be noted that during the transmission by 
telephone/facsimile the selection of an electronic 

2 5 mail address from the telephone directory is inhibited 
and during the transmission by electronic mail the 
selection of a telephone number from the telephone 
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directory is inhibited, to thereby avoid an erroneous 
operation . 

Furthermore, it is possible to set in advance 
whether image data is to be transmitted in an original 
5 image size or is to be transmitted after the size 

thereof is changed into a standardized size (e.g. A4 
size) when image data is transmitted by electronic mail. 
It is also possible to set in advance whether a small 
image in the photographic size, which must be changed 
10 into the A4 size, etc. by adding white pixels for 

transmission by facsimile, is to be positioned at the 
center or the side of a recording sheet. 

A description will be given of the operation of 
the facsimile apparatus in the case where the 
15 electronic mail button is depressed. The following 

three kinds of images can be transmitted as attachments 
to electronic mails: 

•images read by manual scanning using the hand 
scanner 

20 -images read by automatic scanning using the hand 

scanner 102 mounted in the facsimile apparatus 101 

•images captured by a digital camera, etc. and 
stored in an external memory card 

When the electronic mail button is depressed, a 
25 message [Scanner Original Card] is displayed in the 
display section. The input of each image is started 
when the user selects one of Scanner, Original, and 
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Card by operating the key of the operation panel 213. 

If Scanner is selected, an image stored in the 
hand scanner 102 is transferred to the facsimile 
apparatus 101. This will be described later in detail 
5 in w l) the input of an image by reading with the hand 
scanner alone " in the items of description of various 
operations . 

If Original is selected, an operation for reading 
an original is started. This will be described later 
10 in detail in "2) the input of an image by reading a 
sheet" in the items of description of various 
operations . 

If Card is selected, image data is transferred 
from a memory card through the CF card interface 
15 section 253 in the hand scanner 102. This will be 

described later in detail in "3) the input of an image 
from outside" in the items of description of various 
operations . 

It should be noted that an image stored in the 
2 0 scanner or in the external memory card may be 

transmitted by electronic mail by operating the 
operation panel if the hand scanner 102 is mounted in 
the facsimile apparatus 101. This will be described 
later in detail in the description of various 
25 operations. 

There will now be described in detail the various 
operations of the facsimile apparatus in the 
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communication system according to the first embodiment 
of the present invention with reference to the flow 
charts of FIGS. 3 to 8 . 

The present facsimile apparatus is capable of 
5 printing (copying) a read image and transmitting a read 
image by facsimile or electronic mail. One of these 
operations is selected by operating the operation panel 
213. There are three ways for inputting an image as 
follows . 

10 1) An image is read by the hand scanner 101 alone. 

2) A sheet is read in a state wherein the hand 
scanner 102 is mounted in the facsimile apparatus 101; 
and 

3) An image is inputted from the digital camera 
15 103, etc. by way of an external memory card. 

There will now be described the operation of the 
facsimile apparatus in each case. 

1) A case where an image is inputted by reading 
with the hand scanner alone 

2 0 After detaching the hand scanner 102 from the 

facsimile apparatus 101, the user determines whether an 
image should be read as a color image or as a 
monochromatic image with the hand scanner 102 and 
designates a reading width indicative of a reading 

2 5 effective width (step S3 01) . The user then presses a 
start key of the hand scanner 102 (step S302), and 
manually moves the hand scanner 102 to start reading 
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the image (step S303). If it is determined that the 
image should be read as a color image, the CIS 243 
outputs a video signal when the hand scanner 102 starts 
reading a color image, and the outputted video signal 
5 is A/D converted (step S3 04) and shading-corrected 
(step S3 05) . The shading-corrected image data is 
stored as uncompressed image data of 8 bits in RBG 
colors in the RAM 242 (step S306) . 

If it is determined that the image should be read 

10 as a monochromatic image, an original is read in a gray 
scale by the CIS 243 of the hand scanner 102, and is 
A/D converted by the A/D converting section 244 (step 
S3 07) . The data is then shading-corrected by the 
shading-correcting section 245 (step S3 08) , and the 

15 resulting gray scale data (multi-valued data per pixel) 
is binary-coded per pixel by the binary-coding section 
255 (step S3 09) . The data is then MH-compressed by the 
CPU 241 (step S310), and the resulting MH image data is 
stored in the RAM 242 (step S311) . On this occasion, 

2 0 the number of lines in the read image is stored 
separately from the image data (step S3 12) . 

If the hand scanner 102 is mounted in the 
facsimile apparatus 101 after the reading of the image, 
a message [Copy, FAX, E-mail] is indicated in the 

25 display section of the operation panel in the facsimile 
apparatus 101 (step S401) . 

The selection of Copy starts a process for 



printing the image data stored in the hand scanner 102. 
If it is determined that the image data should be read 
as a color image, the resolution of the RGB 
uncompressed image data stored in the RAM 242 of the 
5 hand scanner 102 is converted into a resolution 

suitable for printing by the resolution converting 
section 2 52 (step S403) and is RGB /CMYK converted (step 
S404) into print data, which is temporarily stored in 
the RAM 242. The print data stored in the RAM 242 is 

10 transmitted to the color printer 212 via the shared 
register 210 to print a color image (step S405) . If 
the size of the image is the photographic size and the 
size of the recording sheet is the A4 size, the image 
is printed at the center or the side of the sheet as 

15 predetermined. 

Likewise, the monochromatic MH image data is 
transferred to the facsimile apparatus 101 (body) in 
the same route as described above without being 
processed. A CPU of the facsimile apparatus 101 (body) 

20 expands the MH data (step S406) and outputs it to the 
printer 212 so that a monochromatic image can be 
printed (step S407) . As is the case with the color 
image, if the size of the image is the photographic 
size and the size of the recording sheet is the A4 size, 

25 the image is printed at the center or the side of the 
sheet . 

The selection of FAX starts a process for 



transmitting image data stored in the hand scanner 102 
by facsimile. First, the user selects a FAX 
destination from the telephone directory (step S410) . 
If the user designates a color mode to transmit a color 
5 image obtained by scanning, a signal is transmitted to 
the selected telephone number through the ISDN (S411) . 
If there is a response from the ISDN line 218, the 
resolution of the RGB uncompressed image data stored in 
the RAM 242 is converted into a resolution suitable for 

10 transmission (2 00dpi) by the resolution converting 
section 252. (step S412) . It is then determined 
whether the image data was read in the photographic 
width or not (step S413). If it is determined that the 
image data was read in the photographic width, white 

15 pixels are added to the image data so that the size 
thereof can be equal to the A4 size (step S414) . On 
this occasion, the white pixels are added to the image 
data so that the image can be positioned at the center 
or the side of an A4 size sheet as set in advance. In 

2 0 this case, the white pixels are added so that the image 
can be recorded in the photographic size on an A4 
recording sheet at the destination. The image data is 
then inputted to the color conversion selecting section 
246, and is converted into Lab image data by way of the 

25 T conversion by the 7 converting section A249 (step 
S415) and the RGB/Lab conversion by the RGB/Lab 
converting section 247 (step S416) . The Lab image data 
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is then converted into Lab- j peg image data by the JPEG 
compressing section (step S417) . 

In the description of the present embodiment, JPEG 
image data obtained by JPEG-compressing the Lab image 
5 data is called Lab-jpeg image data, and similarly, JPEG 
image data obtained by JPEG-compressing YCbCr image 
data is called YCbCr-jpeg image data. The obtained 
Lab-jpeg image data is temporarily stored in the RAM 
242 . 

10 If the user designates a monochromatic mode to 

transmit monochromatic MH image data obtained by 
scanning, the MH data is transferred to the facsimile 
apparatus 101 (body) without being processed in the 
above mentioned manner (step S418) . The CPU 2 05 of the 

15 facsimile apparatus 101 determines whether the image 
data was read in the photographic width or not (step 
S419) . If the image data was read in the photographic 
width, white pixels are added to the image data as 
described above so that the size thereof can be equal 

20 to the A4 size after the image data is developed once, 
and the resulting image data is converted again into a 
MH code (step S42 0) . The Lab-jpeg image data or the MH 
image data stored in the RAM 242 in this manner is 
transferred to the fax modem 214 via the shared 

25 register 210. The fax modem 214 modulates an analog 

signal according to the image data (step S421) , and the 
modulated analog signal is converted into a PCM code by 
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the PCM CODEC 237 (step S422) and is transmitted to the 
ISDN line 218 according to the known G3 facsimile 
communication procedure (step S423). 

If a color image is transmitted, the received JPEG 
5 image data received through the ISDN line 218 can be 
expanded and printed if the destination facsimile 
apparatus (FAX 105 in FIG. 1) has a color facsimile 
function. 

The selection of E-mail starts a process for 

10 transmitting the image data stored in the hand scanner 
102 by electronic mail. Since it is legally prescribed 
that predetermined header information must be added to 
electronic mails on the Internet, there is the need for 
adding such predetermined information as "To:" 

15 (destination address), "From:" (sender), "Subject:" 

(subject), "Cc:" (carbon copy), and "Date:" (date) to 
the top of JPEG data that is to be transmitted. 

Accordingly, one is first selected from a 
plurality of registered transmission sources on the 

2 0 operation panel 213 (step S430) . This process may be 
omitted if only one transmission source is registered. 
Each transmission source is comprised of a user name, 
an electronic mail address, a login name, a password, 
an access telephone number, a primary name server 

25 address, a secondary name server address, and an SMTP 
server name. The transmission sources are registered 
according to the above described initial registration 



34 

procedure . 

Next, a destination is selected (step S431) . The 
destination is selected from a registered telephone 
directory or electronic mail directory (step S427), or 
5 is designated by inputting numerals, alphabets and 
marks through numeric keys . The electronic mail 
directory only indicates destinations interpedently 
from the telephone directory. Information inputted 
through the numeric keys can be registered in the 

10 telephone directory or the electronic mail directory. 
Further, a subject is designated (step S432). A 
subject is selected from a registered subject directory 
or is designated by inputting numerals, alphabets, 
hiragana letters, katakana letters, Chinese characters 

15 and marks through numeric keys. The information 

inputted through the numeric keys can be registered in 
a subject directory. 

If it is determined by the user that the image 
data should be read as a color image, a color jpeg 

2 0 image is transmitted as a file attached to an 

electronic mail. Due to its large file size, the RGB 
uncompressed image data stored in the RAM 242 of the 
hand scanner 102 must be compressed and converted into 
jpeg image data of a YCbCr color space for use in the 

2 5 PC. 

Therefore, the resolution of the RGB uncompressed 
image data stored in the RAM 242 is converted into a 
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resolution suitable for transmission (e.g. 200dpi) by 
the resolution converting section 252 (step S433). The 
RGB uncompressed image data is subjected to selection 
of color conversion by the color conversion selecting 
5 section 246 and the 7 conversion by the 7 converting 

section B 251 (step S434) , and further subjected to the 
RGB/YcbCr conversion by the RGB/YcbCr converting 
section 248 (step S435) into image data of the YCbCr 
color space. The resulting YCbCr color space image 

10 data is compressed into YCbCr-jpeg data by the JPEG 

compressing and expanding section 252 (step S436) to be 
temporarily stored in the RAM 242. The YCbCr- jpeg data 
is then transferred to the RAM 2 08 of the facsimile 
apparatus 101 (step S437) , and is stored as a JPEG file 

15 in the SRAM 402. In this electronic mail transmission, 
even a small image in the photographic size is directly 
transmitted without white pixels being added to change 
the size of the image into the A4 size as is the case 
with the above described facsimile transmission. 

2 0 However, if it is set in advance that an image is to be 
transmitted in the A4 size in the electronic mail 
transmission, the size of the image is changed into the 
A4 size by adding white pixels in the same manner as in 
the facsimile transmission. 

25 If it is determined by the user that image data 

should be read as a monochromatic image, a 
monochromatic TIFF image is transmitted as a file 
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attached to an electronic mail. The MH data stored in 
the RAM 242 of the hand scanner 102 is transferred to 
the RAM 208 of the facsimile apparatus 101 (step S440), 
and is stored in the SRAM 204. On this occasion as 
well, the image data in the photographic size is 
directly transmitted, but if the image data is set to 
be transmitted in the A4 size, white pixels are added 
to the image data as is the case with an color image. 

The MH data is then converted into a TIFF file 
that can be handled by the PC. The MH data is changed 
into TIFF format image data by adding a TIFF header 
thereto, but this requires additional data of the 
number of longitudinal lines in an image to be stored 
in the TIFF header. To this end, after transmitting 
the MH data to the facsimile apparatus 101 (body) (step 
S441) , the CPU 241 of the hand scanner 102 transmits 
the data of the number of longitudinal lines in the 
image stored previously in the RAM 242 during the scan 
to the facsimile apparatus 101 (body) via the shared 
register 210. The facsimile apparatus 101 (body) 
produces a TIFF header including the data of the number 
of longitudinal lines (step S442), and adds it to the 
MH image data to produce the TIFF file (step S443) . 

It is complicated to input an attached image file 
name included in the TIFF header by operating the keys. 
Thus, the file name is generated by using the inputted 
subject. If an original of multiple pages is 
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transmitted as an attachment to an electronic mail, the 
number of pages is counted to generate a file name in 
which a page number is added to the end of the subject. 
For example, if the subject is "Original", such file 
names as "Original 1", "Original 2" ... are generated. 

The JPEG/TIFF file generated in the above 
described manner is converted into a text in a known 
method such as base 64 and uuencode, and an electronic 
mail header is added to the JPEG/TIFF file to produce 
electronic mail data (step S445) . 

Upon completion of the electronic mail data, a 
signal is transmitted to the designated provider 106 
through the ISDN. If there is a response from the ISDN 
line, a communication path is connected to set a line 
of communication with the provider. Then, a server of 
the provider is logged in according to a PAP, and the 
electronic mail data stored in the SRAM 2 04 is 
transmitted according to the SMTP protocol. 

Specifically, the electronic mail data is 
transferred from the SRAM 2 04 to the HDLC controller 
221 to be assembled into an HDLC frame, and is then 
transmitted to the provider via the ISDN interface 22 0 
(sep S446) . 

When the PC 107 at the destination of the 
electronic mail receives the electronic mail data via 
the Internet, a user at the destination can obtain a 
JPEG/TIFF data file attached to the electronic mail. 
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The user can also see the received image by software 
such as a browser operating on the PC 107 and having a 
JPEG/TIFF data displaying function. 

After the transmission of the electronic mail, the 
5 destination is stored in a redial buffer or an 

electronic mail redial buffer. The redial buffer sorts 
the transmitted phone messages/transmitted electronic 
mails according to the operation start time to store 
several telephone numbers /addresses in order 

10 sequentially from the latest one. The electronic mail 
redial buffer sorts the transmitted electronic mails 
according to the operation start time to store several 
destination addresses from the latest one. 

It should be noted that a facsimile or electronic 

15 mail may be transmitted after the selection of a 

telephone number /electronic mail address. This is 
started by pressing a telephone directory key on the 
operation panel 213 in the facsimile apparatus 101. 
Upon depression of the telephone directory key, the 

2 0 telephone numbers /electronic mail addresses registered 
in the telephone directory are displayed. An 
electronic mail address can be recognized by a 
character W E" at the end. The selection of a telephone 
number automatically selects a telephone/facsimile 

25 transmission mode, and the selection of an electronic 
mail address automatically selects an electronic mail 
transmission mode. 
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In addition, the above-mentioned electronic mail 
button may be used to transmit an image read by the 
hand scanner 102 by electronic mail. Upon depression 
of the electronic mail button, the message [Scanner 
5 Original Card] is indicated. On this occasion, the 
selection of Scanner enables the transmission of the 
image stored in the hand scanner 102 by electronic mail. 

2) A case where an image is inputted by reading a 

sheet 

10 An image is read from the hand scanner 102 by 

means of the sheet feeder for copying, facsimile 
transmission, and electronic mail transmission with the 
hand scanner 102 being mounted in the facsimile 
apparatus 101 (body) , the user sets an original on the 

15 sheet feeder first (step S500) and selects one process 
from the copy, the facsimile transmission, and the 
electronic mail transmission, by depressing a 
corresponding button (step S501) . 

If a copy button is depressed, the original is fed 

2 0 to cause the hand scanner 102 to start reading the 

image. The CIS 243 of the hand scanner 102 outputs a 
video signal, which is then A/D converted by the A/D 
converting section 244 and is shading-corrected by the 
shading-correcting section 245 (step S502) . The 

2 5 shading-corrected image data is 7 converted by ther 
converting section A249(S503), and the resolution 
thereof is converted into a resolution suitable for 
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printing by the resolution converting section 252 (step 

5504) . The image data is then converted into print 
binary data by the binary-coding section 255 (step 

5505) , and is temporarily stored in the RAM 242. The 
5 print binary data is transferred from the RAM 2 42 to 

the printer 212 via the shared register 210 to be 
printed out (step S506) . 

The transmission by facsimile is started if a 
facsimile transmission button is depressed after the 

10 operation of the dial in the facsimile apparatus 101 or 
is depressed after the selection of a destination 
registered in the telephone directory. Upon selection 
of a destination from the telephone directory (step 
S511) , a signal is transmitted to the selected 

15 telephone number through the ISDN (step S512) . If 

there is a response from the ISDN line 218, a reading 
operation is started. 

The CIS 2 43 of the hand scanner 102 reads an 
original, which is A/D converted by the A/D converting 

20 section 244. RGB image data outputted from the A/D 
converting section 244 is shading-corrected by the 
shading correcting section 245 (step S513). The image 
data is then 7 converted by the 7 converting section A249 
(step S514) , converted into Lab image data by the 

25 RGB/LAB color space converting section 248 (step S515) , 
and coded (compressed) by the JPEG compressing and 
expanding section 250 (step S516) . The resulting JPEG 



data is outputted to the RAM 2 42 of the hand scanner 
102 . 

The JPEG data is transferred from the RAM 242 to 
the fax modem 214 via the shared register 210 (step 
5 S517) . The fax modem modulates an analog signal 
according to the JPEG data (step S518) , and the 
modulated analog signal is converted into a PCM code by 
the PCM CODEC 237 (step S519) and transmitted to the 
ISDN line 218 (step S520) . If the facsimile apparatus 

10 at the destination (FAX 105 in FIG. 1) has a color 

facsimile function, i.e. a Lab-jpeg expanding function, 
the JPEG image data received through the ISDN line 218 
can be expanded and printed. 

If "Original" is selected or an electronic mail 

15 address is selected from the telephone directory after 
the depression of the electronic mail button, the image 
is read to start the transmission by electronic mail. 
Prior to the production of electronic mail data, a 
destination and a subject are designated as described 

2 0 above in 1) "A case where an image is inputted by 

reading with the hand scanner alone" . Upon completion 
of the designation, the production of the electronic 
mail data is started (step S53 0) . 

If an image on a color original is read from the 

2 5 hand scanner 102 by the sheet feeder for transmission, 
the original is read by the CIS 243 of the hand scanner 
102 and is A/D converted by the A/D converting section 
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244. The RGB image data output ted from the A/D 
converting section 244 is shading-corrected as is known 
by the shading-correcting section 245 (step S531) , and 
is r converted by the 7 converting section B 251 (step 
5 S532) , converted into YCbCr image data by the RGB/YCbCr 
color space converting section 248 (step S533), and 
coded (compressed) by the JPEG compressing and 
expanding section 250 (step S534) to output YCbCr-jpeg 
image data to the RAM 242 of the hand scanner 102. 

10 This data is transferred to the RAM 208 of the 

facsimile apparatus 101 (step S535), and is converted 
into a text and is provided with an electronic mail 
header (step S53 6) to produce electronic mail data. 
Upon completion of the production of the 

15 electronic mail data in this manner, a signal is 

transmitted to the designated provider 10 6 through the 
ISDN (step S537). Thereafter, the same operations are 
carried out as in the case where the image is read by 
the hand scanner 102 . 

2 0 In the above described case where an image is 

inputted by reading a sheet, the size of the read image 
data is the standardized size (A4, B4) . It is 
therefore unnecessary to add white pixels or adjusting 
the position as in the case where an image is read by 

25 the hand scanner 102. 

3) A case where an image is inputted from outside 
The hand scanner 102 is equipped with the CF card 
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interface section 253 for connection with the CF card. 
Thus, if JPEG image data captured by the digital camera 
103 or the like is stored in the CF card, mounting the 
CF card in the hand scanner 102 enables the captured 
5 image data to be printed, transmitted by facsimile, or 
transmitted by electronic mail. File names are given 
to JPEG files written in the CF card by the digital 
camera 103 according to a DCF (Design rule for Camera 
File system) . Each file can be represented by a file 

10 ID comprised of three digit numeric value-four digit 
numeric value . 

If the CF card is recognized as being mounted in 
the hand scanner 102 when the hand scanner 102 is 
mounted in the facsimile apparatus 101, the message 

15 [Copy, FAX, E-mail] is indicated in the display section 
of the operation panel 213 in the facsimile apparatus 
101 (step S601) . Upon selection of one process from 
[Copy, FAX, E-mail] , it is determined whether a file ID 
of an image to be processed next is to be designated on 

2 0 the operation panel 213 or to be designated in a DPOF 
(Digital Print Order Format) or the like in advance 
through the camera (step S602) . 

In the former case, an ID of a file to be 
transmitted is inputted using the operation panel 213 

25 (step S603) . In the latter case, an ID of a file to be 
processed is obtained by analyzing a DPOF file in the 
CF card (step S604) . The file is then read from the CF 
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card (step S605) . It should be noted that the DPOF is 
a format standard of a command file (DPOF file) , which 
is written in a recording medium to indicate how the 
image files in the recording medium are to be handled 
5 (e.g. printed or transmitted to a specified 

destination) and is recognized by an apparatus (e.g. 
FAX) into which the CF card is inserted so that the 
image files can be automatically printed or transmitted 
by electronic mail. 

10 In the case where a file ID is designated on the 

operation panel 213, the file ID is selected from a 
list of files by using a cursor key or is directly 
designated by using the numeric keys. It is possible 
to select a plurality of images, which are specified by 

15 designating the first value and the last value of a 
file ID for use in transmission. 

If Copy is selected at the step S601, the YCbCr- 
jpeg data read out from the CF card is expanded into 
uncompressed RGB image data by the JPEG compressing and 

20 expanding section 250 (step S607) . The resolution of 
the uncompressed RGB image data is converted into a 
resolution suitable for printing by the resolution 
converting section 2 52 (step S608) , and is converted 
into CMYK binary print data by the binary-coding 

25 section 255 (step S609) . The resulting print data is 
temporarily stored in the RAM 242. The print data 
stored in the RAM 242 is transmitted to the color 
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printer 212 via the shared register 210 to print an 
image (step S610) . 

If FAX is selected, the JPEG data read out from 
the CF card is temporarily expanded into uncompressed 
5 RGB data by the JPEG compressing and expanding section 
250 (step S620) . The resolution converting section 252 
changes the size of the uncompressed RGB data so that 
the resolution thereof can become equal to a resolution 
suitable for transmission (200dpi) (step S621) , and the 

10 resulting data is temporarily stored in the RAM 242. 
On this occasion, the size of the data is changed 
according to the conditions preset by the user. For 
example, the user determines in advance whether 1) 
white pixels are to be added to image data after the 

15 size is changed such that the width of an image thereof 
becomes equal to the A4 width and the aspect ratio is 
unchanged, or 2) white pixels are added to image data 
after the size is changed such that it becomes equal to 
the photographic size when the data is recorded on an 

20 A4 recording sheet at a destination. Then, the RGB 
uncompressed image data is inputted to the color 
conversion selecting section 246, and is converted into 
Lab-jpeg data by way of the 7 conversion by the 7 
converting section A 251 (step S622) and the RGB/Lab 

2 5 conversion by the RGB /Lab converting section 2 47 (step 
S623) , and is stored again in the RAM 242. 

Next, upon selection of a destination from the 
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telephone directory, a signal is transmitted to the 
selected telephone number through the ISDN. If there 
is a response from the ISDN line 218, the Lab-jpeg data 
stored in the RAM 242 is transferred to the fax modem 
5 214 via the shared register 210 (step S625) . The fax 
modem 214 modulates an analog signal according to the 
JPEG data (step S62 6) . The modulated analog signal is 
converted into a PCM code by the PCM CODEC 237 (step 
S627), and is transmitted to the ISDN line 218 (step 
10 S628) . 

If E-mail is selected, the JPEG data read out from 
the CF card is directly transmitted without being 
processed in the form of a file attached to an 
electronic mail since the JPEG data can be seen in the 

15 form of a file on the PC. However, if a large number 
of pixels is designated during a photographing 
operation by the digital camera, it is impossible to 
store all the captured jpeg image data in the RAM 242 
or the RAM 2 08 or it takes much time to convert the 

2 0 image data into texts and transmit the image data due 
to the excessively large file size of the jpeg image 
data. Therefore, in the present embodiment, if a file 
to be transmitted has a larger file size than a 
predetermined size, the file is not transmitted as an 

25 attachment to an electronic mail and a message to this 
effect is indicated in the display section of the 
operation panel 213. 
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After the user designates a file to be transmitted, 
the CPU 205 of the facsimile apparatus 101 obtains the 
file size of the designated file from the CPU 241 of 
the hand scanner 102 prior to the transfer of the data 
5 (step S63 0) . If the obtained file size is larger than 
a maximum allowable size (x bytes) , a warning message 
is indicated on the operation panel 213 to stop the 
transmission (step S632) . On this occasion, the value 
of "x" indicative of the maximum allowable size (x 

10 bytes) may be a fixed value (set on the operation panel 
213) or may be varied according to the residual 
capacity of the RAM 208. If the obtained file size is 
smaller than x bytes, the designated JPEG file is read 
into the RAM 242 (step S633) . 

15 Next, if the electronic mail address of the 

destination of the electronic mail is selected from the 
telephone directory, the JPEG data stored in the RAM 
242 is transferred to the SRAM 204 via the shared 
registers 210 and 2 09 so as to produce data attached to 

2 0 the electronic mail. Electronic mail data is then 

produced and transmitted in the same manner as the step 
S323 . 

The details of the transmission by electronic mail 
are the same as already described above. It should be 
2 5 noted that a name is given to an image captured by the 
digital camera 103. In this case, an image name is 
received from the CF card, and is directly used as a 
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file name for an attached image. If no name is given 
to an image, a subject is directly used as a file name 
as is the case with an image read by the hand scanner 
102 . 

5 The above-mentioned electronic mail button may be 

used for transmission of an image stored in the 
external memory card. The depression of the electronic 
mail button indicates the message "Scanner Original 
Card". On this occasion, the selection of Card enables 
10 the transmission of an image stored in the hand scanner 
102 . 

As described above, the facsimile apparatus 
according to the first embodiment of the present 
invention transmits an image by electronic mail in 

15 substantially the same size as the original size when 
the original size, i.e. the size of the image is the 
photographic size (L size) or the like smaller than the 
A4 size as the standardized size, thus reducing the 
transmission data size or amount and providing an image 

2 0 that can easily be seen on the display, etc. at the 
destination . 

On the other hand, in the transmission of such an 
image by facsimile, the facsimile apparatus according 
to the above embodiment transmits the image in the 
2 5 standardized size according to the facsimile standards 
by adding white pixels thereto to a destination, so 
that an image can be properly laid out in substantially 



the same size as the original size at the destination. 

Moreover, the facsimile apparatus according to the 
above embodiment can be used in a more convenient 
manner since whether the white pixels should be added 
5 for transmission by electronic mail and how the white 
pixels should be added for transmission by facsimile 
are determined according to the predetermined 
conditions . 

Although, in the above described embodiment, the 

10 conditions related to setting of the image size for 
transmission and addition of white pixels are set 
irrespective of the destination, different conditions 
may be set according to destinations. In this case, 
the conditions are set for respective destinations in 

15 the telephone directory. 

Moreover, when a plurality of images in the 
photographic size are transmitted by facsimile, the 
plurality of images may be added to one page. Whether 
a plurality of images is added to one page may also be 

2 0 determined in advance. 

It goes without saying that the same image can be 
transmitted by electronic mail and facsimile in the 
above embodiment . 
[Second embodiment] 

2 5 A communication system incorporating an image 

processing apparatus according to the second embodiment 
of the present invention is comprised of a facsimile 
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apparatus 101, a hand scanner 102, a digital camera 103, 
a communication network 104 such as an ISDN (Integrated 
Services Digital Network) , a facsimile apparatus (FAX) 
105 at a destination, an internet service provider 
5 (ISP) 106, and a computer (PC) 107 (see FIG. l)at a 
destination . 

The facsimile apparatus 101 according to the 
second embodiment is comprised of a CPU 201, a ROM 2 03, 
a SRAM 2 04, a CPU 205, a ROM 207, a RAM 208, a shared 

10 register 2 09, a shared register 210, a printer image 
processing section 211, a color printer 212, an 
operation panel 213, a fax modem 214, a handset 215, a 
speaker 216, a cross point switch 217, a DSU 219, an 
ISDNI interface 220, a HDLC controller 221, a PIAFS 

15 controller 222, a PHS processing section 223 having a 
CPU 224 and a TDMA processing section 225, a 1 . 9GHz 
high frequency section 22 6, a PCM CODEC 227, a PCM 
CODEC 228, a PCM/ADPCM converting section 229, a 
PCM/ADPCM converting section 23 0, a path selector 

20 switch 231, and a path selector switch 232. The hand 

scanner 102 is comprised of a CPU 241, a RAM 241, a CIS 
243, an A/D converting section 244, a shading 
correcting section 245, a color conversion selecting 
section 246, a RGB/LAB color space converting section 

25 247, a RGBY/CbCr color space converting section 248, a 
T converting section A 249, a JPEG compressing 
expanding section 250, a 7 converting section B 251, a 



resolution converting section 252, a CF card interface 
253, and a binary-coding section 255 (see FIGS. 2A and 2B) . 

Elements and parts corresponding or similar to 
those of the first embodiment are denoted by the same 
5 reference numerals, and a detailed description thereof 
is omitted herein. 

According to the first embodiment, the shading- 
corrected RGB uncompressed data is stored in the RAM 
242 of the hand scanner 102 if an image is manually 

10 scanned by the hand scanner 102 in the color reading 
mode. However, if an A4 original is read at a 
resolution of 2 00dpi, the data size is as large as 
about 12MB so that the storage of the RGB uncompressed 
data in the RAM 242 of the hand scanner 102 

15 necessitates the use of a RAM having a a capacity 

enough to store such large data, which increases the 
cost of the apparatus. 

It is therefore desirable to compress the RGB data 
in some compression method and store the compressed 

2 0 data in the RAM 242 of the hand scanner 102 when an 
image is read. However, if the data is stored as 
YCbCr-jpeg data, for transmission of color image data 
by facsimile, the data must be temporarily expanded 
into uncompressed RGB data and then compressed again 

25 into Lab-jpeg data. The repetition of JPEG expansion 

and compression unavoidably deteriorates the quality of 
the image data. On the other hand, even if the data is 
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stored as Lab- j peg data, the quality of the image data 
is deteriorated since it must be converted into YCbCr- 
jpeg data for transmission by electronic mail. 

Therefore, according the second embodiment, when 
5 the user manually scans an image by the hand scanner 
102, the CPU 201 of the facsimile apparatus 101 checks 
whether image data is stored in the RAM 242 of the hand 
scanner 102 or not. If the image data is stored in the 
RAM 242 of the hand scanner 102, different processes 

10 are carried out depending upon the image width 
designated by the user. 

The photographic width, the A4 width, and the B4 
width can be designated as the image width, and the 
designation of each size restricts the process as 

15 follows. 

1) The photographic width: a monochromatic image 
is MH compressed during scanning, and a color image is 
scanned uncompressed. 

2) The A4 width, a monochromatic image is MH 
2 0 compressed during scanning, and a color image is 

scanned and YCbCr-jpeg compressed to be written into 
the RAM 242. However, this JPEG data is not 
transmitted but may only be printed with the hand 
scanner 102 being mounted in the facsimile apparatus 
25 101 (body) . 

3) The B4 width: a monochromatic image is MH- 
compressed during scanning, and a color image is never 



scanned. 

A description will be given of the operation in 
the case where a color image in the photographic width 
is scanned as in the above item 1} . During the 
5 scanning, the same operations are carried out as in the 
first embodiment except that the image width is the 
photographic size. When the hand scanner 102 is 
mounted in the facsimile apparatus 101 after the 
reading of the image, the message [Copy, FAX, E-mail] 

10 is indicated in the display section of the operation 
panel 213 of the facsimile apparatus 101 to urge the 
user to select one operation. 

The selection of Copy starts a process for 
printing the image data stored in the hand scanner 102. 

15 This process is similar to that of the first embodiment. 
The selection of FAX starts an operation for 
transmitting the image data stored in the hand scanner 
102 by color facsimile. In this case, however, it is 
necessary to increase the width of the image in the 

2 0 photographic width since the image width is recommended 
to be the A4 size in color facsimile according to CCITT. 
White pixels {R, G, B)=(255, 255, 255) are added to the 
right and left of a RGB uncompressed image obtained by 
scanning so that the image width can be equal to the A4 

25 width (1728 pixels at the resolution of 200dpi) . The 
image is then Lab-jpeg compressed, and the resulting 
JPEG data is transmitted in the same manner as in the 
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first embodiment. 

If E-mail is selected, the RGB uncompressed image 
in the photographic width is YCbCr-jpeg compressed 
since there is no need for adding white pixels and the 
5 resulting JPEG data is transmitted as an attachment 
file in the same manner as in the first embodiment. 

There will now be described the operation in the 
case where a color image in the A4 width is scanned as 
in the above item 2) . During the scan, RGB image data 

10 obtained by shading correction is converted into YCbCr 
uncompressed image data via the J converting section B 
249 and the RGB/YCbCr converting section 2 51 and is 
then compressed into YcbCr-jpeg image data by the JPEG 
compressing and expanding section 250 to be stored in 

15 the RAM 242 as is distinct from the first embodiment. 
If the hand scanner 102 is mounted in the 
facsimile apparatus 101 (body) in this state, the 
messages [Copy FAX E-mail] are indicated in the display 
section of the operation panel 213 of the facsimile 

20 apparatus 101 (body) similarly to the first embodiment. 
However, even if the user selects FAX or E-mail, a 
warning is displayed to inhibit the transmission by 
facsimile or electronic mail. If the user selects Copy, 
the YCbCr-jpeg data stored in the RAM 242 is expanded 

25 once into RGB uncompressed image data by the JPEG 
compressing and expanding section 250, and the 
resolution thereof is converted into a resolution 
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suitable for printing by the resolution converting 
section 252. The image data is then converted into 
binary data by the binary-coding section 255, and the 
resulting data is sent to a printer of the facsimile 
5 apparatus 101 (body) so that it can be printed out. 

It goes without saying that image data may be 
transmitted in the case where a color image in the A4 
width is scanned by the hand scanner 102 . 

Specifically, to transmit electronic mail data by 

10 electronic mail, the CPU 201 of the facsimile apparatus 
101 converts the read image data into an electronic 
image file by changing the width thereof according to a 
predetermined reading image width, and transmits the 
electronic image file as electronic mail data. To 

15 transmit electronic image data by color facsimile, the 
CPU 201 of the facsimile apparatus 101 provides control 
such that white pixels are added to the electronic mail 
data so that the width thereof can be equal to a 
predetermined image width. Therefore, the changing of 

2 0 the width of an image file to be transmitted as an 
attachment to an electronic mail according to the 
predetermined reading width of an image on an original 
makes it easier to see the area of the original since 
no unnecessary area is displayed when the image file is 

25 opened at a receiving side, and also restricts other 
processes to thereby eliminate the need for using a 
large memory capacity. 
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The process in the second embodiment and the 
process in the first embodiment may be switched 
according to whether or not an expanded memory (RAM) is 
installed in the communication system. Specifically, 
5 the process in the first embodiment is carried out if 
the expanded memory is installed in the communication 
system, and the process in the second embodiment is 
carried out if the expanded memory is not installed in 
the communication system. Indications may be displayed 

10 on the operation panel 213 as to whether the expanded 
memory is installed or not and that the process is 
restricted in the case where the expanded memory is not 
installed so that the user can know these facts. 
[Variation of the first and second embodiments] 

15 Although in the first and second embodiments it is 

assumed that an image is transmitted by facsimile or 
electronic mail through the ISDN, it may be considered 
that an image is transmitted to an in-house or 
neighborhood computer through a radio communication 

2 0 medium such as Bluetooth, IrDA (Infrared Data 

Association) and PHS (Personal Handy-phone System) or a 
wire communication medium such as USB (Universal Serial 
Bus) and IEEE (Institute of Electrical and Electronics 
Engineers) 1394. 

2 5 FIG. 9 is a schematic block diagram showing the 

arrangement of a communication system according to a 
variation of the first and second embodiments of the 



present invention. The communication system according 
to the variation of the first and second embodiments is 
comprised of a facsimile apparatus 101, a hand scanner 
102, a digital camera 103, a communication network 104 
5 such as ISDN, a facsimile apparatus (FAX) 105 at a 

destination, an internet service provider (ISP) 106, a 
computer (PC) 107 at a destination, and computers (PC) 
108, 109 placed in the same house as the facsimile 
apparatus 101. 

10 The arrangement of essential parts of the present 

communication system will now be described in detail. 
The computer (PC) 108 communicates with the facsimile 
apparatus 101 through a radio communication network 110, 
such as Bluetooth, IrDA or PHS . The computer (PC) 109 

15 communicates with the facsimile apparatus 101 through a 
radio communication network 111, such as USB (Universal 
Serial Bus) or IEEE 13 94. Otherwise, the present 
communication system is constructed in the same manner 
as those of the first and second embodiments. It 

2 0 should be noted that image data for use in the 

communication of the present communication system is 
produced by JPEG compressing image data of the YCbCr 
color space as is the case with the image transmission 
by electronic mail. 

2 5 This variation is different from the image 

transmission by electronic mail in the first and second 
embodiments in that, in response to an instruction for 



starting the transmission, a signal is not transmitted 
to the ISDN line but a communication link is 
established according to a communication protocol of a 
communication medium used for communication. By 
5 transmitting JPEG data on the established communication 
line, it is possible to see an image on the computers 
108, 109, etc. having a JPEG expanding function. 
[Other embodiments] 

In the first and second embodiments described 

10 above, the processing mode is selected according to 
such a message as "Print? FAX transmission? E-mail 
transmission?". That is, the image transmission mode 
is selected in addition to the processing mode. Thus, 
such dedicated keys as a "FAX key" and an "electronic 

15 mail button" may be provided on the operation panel 213. 

On the other hand, in the transmission of an image, 
the transmission mode is automatically determined by 
determining whether a selected abbreviated number 
corresponds to a telephone number of the facsimile 

20 apparatus 101 or an electronic mail address. If such 
determination is made, the message can be shortened to 
"Print? Transmission?". If the selected abbreviated 
number (telephone directory) corresponds to a telephone 
number of the facsimile apparatus 101, a character "F" 

25 is indicated at the side of the name. If the selected 
abbreviated number corresponds to an electronic mail 
address, a character "E" is indicated at the side of 
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the name. This makes it easier to identify a user of 
the facsimile apparatus 101. 

In the first and second embodiments described 
above, assuming that ISDN is applied as a public 
5 network, the analog signal modulated by the modem is 
converted into the PCM code in the case of facsimile 
transmission and the data assembled into the HDLC frame 
is directly transmitted to the ISDN in the case of 
electronic mail transmission. The public network, 

10 however, may also be an analog line (PSTN: Public 

Switched Telephone Network) . If the analog line is 
used for facsimile transmission, the analog signal 
modulated by the modem is directly transmitted to the 
analog line. In the case of electronic mail 

15 transmission, an analog signal modulated according to 

the electronic mail data by the modem is transmitted to 
the analog line. 

It is also possible to use a variety of other 
communication lines, e.g. LAN (Local Area Network) such 

2 0 as Ethernet. 

In the above described first and second 
embodiments, the color space converting section is 
accommodated in the hand scanner 102, but it may be 
accommodated in the facsimile apparatus 101. Moreover, 

2 5 the same effects can be achieved irrespective of 

whether the color space converting process and the JPEG 
compressing and expanding process are carried out by 
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hardware or software. 

Although in the above described first and second 
embodiments, it is assumed that the hand scanner 102 is 
detached from the facsimile apparatus 101 to read an 
5 image, but this not limitative, but the same effects 

can be achieved irrespective of whether or not the hand 
scanner 102 is mounted in the facsimile apparatus 101 
and whether or not the hand scanner is detachable from 
the facsimile apparatus 101. 

10 Further, although in the above described first and 

second embodiments, the JPEG compression method using 
DCT is used for coding, other compression methods such 
as a color compression method using wavelet 
transformation may be used for coding. Moreover, the 

15 color space of the image data before DCT should not 

necessarily be Lab or YCbCr, but other color spaces may 
be used. 

Further, in the above described first and second 
embodiments, a subject is directly used as the name of 

2 0 an attached file, an arbitrary character string may be 
used without using a subject. 

Further, although the above descriptions of the 
first and second embodiments and the variation thereof 
are based on examples of arrangements shown in FIGS. 1 

2 5 and 9, it should be understood that there is no 

intention to limit the number of facsimile apparatuses, 
hand scanners, digital cameras, computers, etc. 
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Further, although the above embodiments and 
variation are based on an example of the facsimile 
apparatus having the facsimile transmitting function 
and the electronic mail transmitting function, the same 
5 effects can be achieved by using a personal computer in 
which, for example, applications for producing and 
transmitting E-mail data and facsimile data are 
installed. Also, applications for only producing 
electronic mail data and facsimile data without 

10 transmitting them may be installed in the personal 

computer. In such a case, electronic mail data with an 
attached file produced as in the above described 
embodiments is transferred to an application for 
electronic mail transmission so that it can be 

15 transmitted by electronic mail, and facsimile data is 
transferred to a facsimile transmitting application so 
that it can be transmitted by facsimile. 

As described above, the present invention may be 
applied to various kinds of systems, such as a system 

2 0 comprised of multiple equipment (e.g. a host computer, 
interface equipment, a reader, and a printer) , and a 
system comprised of one equipment (e.g. a host computer, 
interface equipment, a reader, and a printer) . 

It goes without saying that the present invention 

25 may be accomplished by installing program code of 

software realizing the functions of any of the above 
described embodiments and variation in a medium such as 
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a storage medium (or a recording medium) of the system 
or the apparatus, and causing a computer (or CPU or 
MPU) of the system or the apparatus to read out and 
execute the program code read out from a medium such as 
5 the storage medium (or the recording medium) . 

In this case, the program code itself which is 
read out from a medium such as the storage medium (or 
the recording medium) realizes the functions of any of 
the above described embodiments and variation, and the 

10 medium such as the storage medium (or the recording 
medium) storing the program code constitutes the 
present invention. The storage medium (or the 
recording medium) for recording the program code may be 
a floppy disk, a hard disk, an optical memory disk, an 

15 magneto-optical disk, a CD-ROM, a CD-R (CD-Recordable) , 
a magnetic tape, a nonvolatile memory card, a ROM, a 
download through a network, for instance. 

Further, it goes without saying that the present 
invention encompasses a case in which the functions of 

2 0 any of the above described embodiments and variation 

are accomplished not only by executing the program code 
read out by the computer, but also by causing an 
operating system (OS) operating on the computer to 
perform a part or all of actual operations according to 

25 the instructions of the program code. 

Further, it goes without saying that the present 
invention encompasses a case in which the program code 



read out from the storage medium (or the recording 
medium) is written into a memory provided in an 
expanded function board inserted into the computer or 
in an expanded function unit connected to the computer, 
5 and then the CPU or the like integrated in the expanded 
function board or the expanded function unit performs a 
part or all of actual operations according to the 
instructions of the program code so as to accomplish 
the functions of any of the above described embodiments 
10 and variation. 

If the present invention is applied to the above- 
mentioned storage medium, the storage medium stores 
program code corresponding to the flow charts explained 
above . 

15 FIG. 11 is a view useful in conceptually 

explaining a state in which a program and related data 
for executing the image processing method according to 
the present invention are supplied from the storage 
medium to an apparatus such as a computer. The program 

2 0 and related data for executing the transmission image 
control method according to the present invention are 
supplied by inserting a storage medium such as a floppy 
disk and a CD-ROM into an insertion opening 1103 of a 
storage medium drive integrated in an apparatus 1102 

25 such as a computer. Then, the program and related data 
for executing the electronic mail transmission control 
method according to the present invention are 
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temporarily installed in a hard disk and loaded from 
the hard disk into a RAM, or are directly loaded into 
the RAM without being installed in the hard disk so as 
to execute the program and related data. 
5 In this case, if the program and related data for 

executing the electronic mail transmission control 
method according to the present invention are executed 
in the facsimile apparatus according to the first and 
second embodiments of the present invention and the 

10 variation, the program and related data are supplied to 
the facsimile apparatus through the apparatus such as a 
computer as described above with reference to FIG. 11 
or the program and related data are preinstalled in the 
facsimile apparatus so as to execute the program. 

15 FIG. 10 is a view useful in explaining the 

arrangement of the contents of the storage medium 
storing the program and related data for executing the 
image processing control method according to the 
present invention. The contents of the storage medium 

2 0 are comprised of volume information 1001, directory 
information 1002, a program execution file 10003, a 
program related data file 1004, and the like. The 
program executing the electronic mail transmission 
control method according to the present invention is 

25 converted into program code according to the flow 
charts described above. 

As set forth hereinabove, in the above described 
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embodiments, if electronic mail data is transmitted by 
electronic mail, the facsimile apparatus converts the 
read image data into an electronic image file while 
changing the width thereof according to a predetermined 
reading image width set by the scanner and transmits 
the image file as electronic mail data, and if 
electronic image data is transmitted by color facsimile, 
the facsimile apparatus provides control such that 
white pixels are added to the electronic mail data so 
that the width thereof can be equal to a predetermined 
image width. By thus changing the width of an image 
file to be transmitted as an attachment to an 
electronic mail according to a predetermined image 
width, an image properly laid out in a proper size can 
be reproduced at a facsimile receiving side and there 
is no unnecessary area when the image file is opened at 
the electronic mail receiving side. This makes it 
easier to see the area of the original and hence 
reduces the amount of data. 

It should be understood, however, that there is no 
intention to limit the invention to the specific forms 
disclosed, but on the contrary, the invention is to 
cover all modifications, alternate constructions and 
equivalents falling within the spirit and scope of the 
invention as expressed in the appended claims. 



